🕷️️ Job Radar • SCRAPING

upwork.com 🟠 2026-05-10

🔹 Technical Manifest for Deep Web / OSINT Researcher Position
👤 Client: LTU Member since 2025-04-11
💰 Price: ****
🚩 Problem: Extract and structure detailed, verifiable leads from deep web sources to identify industrial asset opportunities.
📦 Existing: Not specified

Specifications:

[Target] Identify and document hard-to-find industrial assets in energy, power generation, MRO, surplus equipment, auctions, liquidation notices, tender portals, shipping records, and company filings.
[Method] Utilize deep web research techniques including public databases, procurement portals, archived listings, trade records, industry directories, and specialist marketplaces.
[UI/UX] Not applicable
[Stack] Python (BeautifulSoup, Scrapy), SQL for database management, Git for version control, Jupyter Notebooks for data analysis, Google Sheets or Excel for lead documentation.
[Security] Ensure all research methods comply with legal and ethical standards; maintain confidentiality of sources and leads.
[Format] JSON or CSV for structured lead lists including asset status, contact details, proof links, and next recommended actions.

Workflow:

1. Define search parameters based on target industries (energy, power generation, MRO, etc.).
2. Crawl and scrape deep web sources using Python libraries like BeautifulSoup or Scrapy.
3. Verify ownership and track asset history through cross-referencing multiple sources.
4. Filter out broker noise and document real opportunities with clear sources and proof links.
5. Structure leads into JSON or CSV format, including asset status, contact details, and next recommended actions.